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Description 

[0001] This invention relates to a multitasking micro- 
controller and to a data processing system employing 
such a multitasking microcontroller operable to control a 
plurality of hardware engines and it further relates to a 
method of controlling task switching. 
[0002] A multitasking computer system consisting of 
plural processors (CPU) is described in US-B-4 91 4 570. 
A process is assigned to one CPU and an entry referring 
to that process is created in a run queue of said CPU. 
Each CPU selects a process from its run queue according 
to the priority of each process. Specific tasks, which can 
not be performed by the CPU a process is assigned to, 
are performed by a different CPU suitable for performing 
said tasks. For that purpose, the process is transferred 
to the run queue of that CPU. When the specific tasks 
are done, the process returns to the run queue of the 
original CPU. 

[0003] US-A-5 655,1 46 describes a computer system 
comprising central processors and coexecutors for exe- 
cuting offloaded functions in accordance with requests 
from programs running on a central processor. The co- 
executors execute the offloaded functions in parallel with 
the central processors executing non-offloaded func- 
tions. A host OS handles dynamic scheduling of the co- 
executor's operation. Specifically, operation requests to 
the coexecutors are stored in queues and coexecutors 
are signaled to perform a requested operation. Comple- 
tion signals are issued by the coexecutors in order to 
notify a program which issued the request and to process 
the next request in the queues. 

[0004] Both prior art references use a conventional in- 
terrupt driven task management and software schedul- 
ing. 

[0005] Multitasking microcontrollers have been known 
in the art. In a typical multitasking microcontroller, a built- 
in processor sequentially executes a plurality of tasks 
and a task timer therefore makes periodic issues of timer 
interruptions which request task switching to be made. 
Every time the processor accepts such a timer interrup- 
tion, an interruption handling routine in the operating sys- 
tem (OS) is activated. The interruption handling routine 
performs the scheduling of tasks and the saving and re- 
storing of resources. 

[0006] Conventional multitasking microcontrollers 
have some drawbacks. For example, the scheduling of 
tasks is carried out using an interruption handling routine 
in a conventional multitasking microcontroller. This pro- 
duces the problem that there is created much overhead 
at task switching time, therefore resulting in a drop in 
microcontroller performance. This is a serious problem 
for the applications which attach great importance to real- 
time processing such as image data encoding. 
[0007] Such a technology is described in IEEE Journal 
of Solid-State Circuits vol. 29, No. 12, December 1994, 
p. 1474 - 1481 for an MPEG2 CODEC. 
[0008] It is an object of the present invention to provide 



an improved control of a pipelined data processing sys- 
tem. 

[0009] This object is achieved by the features of claim 
1. 

5 [0010] Further embodiments are subject-matter of de- 
pendent claims. 

[0011] In accordance with the present invention, a plu- 
rality of tasks are allocated to respective hardware en- 
gines. In such an environment, a task switching operation 
10 is controlled by the hardware scheduler on the basis of 
information representative of the allocation of the tasks 
to the hardware engines. Some of the hardware engines 
execute time critical processes and the other hardware 
engines do not. In accordance with the present invention, 
15 a relationship among the hardware engines is reflected 
in the execution priority of the tasks, which makes it pos- 
sible to select a task to be run next in a short time without 
redeterming which of the hardware engines executes a 
time critical process at the time of task switching. In other 
words, there is created less overhead when task switch- 
ing occurs. High-speed task switching is realized. 
[001 2] Undesirable dead time occurs in a time sharing 
method which carries out switching between tasks in re- 
sponse to an interruption periodically issued by a task 
timer, in view of which the present invention was made. 
Accordingly, the microcontroller of the present invention 
adopts an event-driven method capable of performing 
task switching in fast response to the occurrence of an 
event (i.e., an event of hardware engine execution ter- 
mination). Each taskcan be in one of at least three states: 
a first state (the state of READY) representative of an 
execution wait status, a second state (the state of AC- 
TIVE) representative of a running status, and a third state 
(the state of SLEEP) representative of an allocated hard- 
ware engine execution termination status. A task is in the 
state of ACTIVE when it uses the microcontroller and in 
the state of ACTIVE a hardware engine allocated to the 
task is controlled. A task is in the state of READY when 
it is notselected therefore waiting to be selected although 
it is ready to use the microcontroller. A task is in the state 
of SLEEP when it waits for a hardware engine allocated 
thereto to be execution-terminated (in other words, it is 
not ready to use the microcontroller). A task that has fin- 
ished activating its allocated hardware engine makes a 
state transition from ACTIVE to SLEEP in response to a 
given instruction (the task_sleep instruction). When the 
execution of a certain hardware engine is terminated, a 
task allocated to that hardware engine makes a state 
transition from SLEEP to READY and a task under exe- 
cution makes a state transition from ACTIVE to READY. 
Thereafter, a task having the highest execution priority 
in all tasks assuming the state of READY is selected as 
a task to be run next. The task thus selected makes a 
state transition from READY to ACTIVE. 
[001 3] If a plurality of register files are prepared in the 
microcontroller so that a plurality of hardware engines 
can use the register files as mutually independent work- 
ing areas, there is created much less overhead at the 
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time of task switching because what is required to do at 
the task switching time is justsaving processor resources 
such as program counter. A register file for storing a set- 
ting parameter common to a plurality of hardware en- 
gines can be prepared in the microcontroller. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] 

FIGURE 1 is a block diagram showing the structure 
of an MPEG image encoder in accordance with the 
present invention. 

FIGURE 2 is a block diagram showing details of the 
structure of a microcontroller of FIGURE 1. 
FIGURE 3 is a block diagram showing details of the 
structure of a task controller of FIGURE 2. 
FIGURE 4 is a conceptual diagram showing an as- 
sociation between cores and tasks in the MPEG im- 
age encoder of FIGURE 1 . 

FIGURES is aconceptual diagram showing the state 
transition of a task in the MPEG image encoder of 
FIGURE 1. 

FIGURE 6 is a timing diagram showing macroblock 
pipeline processing by the five cores of FIGURE 1 . 
FIGU RE 7 is atiming diagram showing the state tran- 
sition of three tasks during a part period of FIGU RE 6. 

DETAILED DESCRIPTION OF THE INVENTION 

[0015] FIGURE 1 shows an MPEG (Moving Picture 
Experts Group) image encoder which is one of the data 
processing systems in accordance with the present in- 
vention. Referring to FIGURE 1, the MPEG image en- 
coder has a single microcontroller 101, five different hard- 
ware engines (hereinafter called the cores) 111-115 to- 
gether forming a macroblock pipeline, and three buffer 
memories 116-118. The core 111 is a motion detector 
(MD). The core 1 12 is a motion compensator (MC). The 
core 113 is a discrete cosine transformer (DCT). The 
core 114 is a quantizer (Q). The core 115 is a variable 
length coder (VLC). All the cores 111-115 are controlled 
by the microcontroller 101. 121 is image data to be en- 
coded and 122 is encoded data representative of a result 
of the encoding operation. The microcontroller 101 sends 
an activation signal 123 to each core 111-115 and re- 
ceives a termination signal 124 from each core 111-115. 
The microcontroller 101 is allowed to individually com- 
municate with each core 111-115 through signal lines 
131-135. Additionally, the microcontroller 101 provides 
a parameter common to the five cores 111-115 through 
a signal line 136. 

[0016] FIGURE 2 shows in detail the structure of the 
microcontroller 101. The microcontroller 101 has a task 
controller 201 for the realization of multitasking, five core 
register files 211-215 for use by the five cores 111-115 
as mutually independent working areas, a single com- 
mon register file 21 6 for storing a setting parameter com- 



mon to at least two of the five cores 111-115, a single 
general-purpose register file 21 7 for use by the task con- 
troller 201 as a working area, a multiplier 221, a shifter 
222, an arithmetic and logic unit (ALU) 223, and a data 

5 memory 224. 241 is an A bus. 242 is a B bus. 243 is a 
C bus. 231 is a signal line for connecting together the 
buses 241-243 and the task controller 201 . Thetaskcon- 
troller 201 provides the activation signal 1 23 and receives 
the termination signal 124. Each of the register files 

10 21 1 -21 6 is connected between the C bus 243 and a cor- 
responding one of the signal lines 131-136. Additionally, 
each of the register files 211-216 has two outputs that 
are connected to the A bus 241 and to the B bus 242 
respectively. The general-purpose register file 217 and 

15 the data memory 224 each have a single input that is 
connected to the C bus 243 and two outputs that are 
connected to the A bus 241 and to the B bus 242 respec- 
tively. The multiplier 221, the shifter 222, and the ALU 
223 each have two inputs that are connected to the A 

20 bus 241 and to the B bus 242 respectively and a single 
output that is connected to the C bus 243. A variation to 
the above can be made in which the placement of the 
five core register files 21 1 -21 5 and the common register 
file 216 is omitted and the signal lines 131-136 extend 

25 directly form the C bus 243. 

[0017] In accordance with the MPEG image encoder 
of FIGURE 1, image data processes proceed in units of 
macroblocks each containing 16x16 pixels. Firstly, the 
MD core 111 finds candidate motion vectors about the 

30 input image data 121 . In the MC core 112, image differ- 
ential data are found using the candidate motion vectors 
to select an optimal motion vector. Differential data with 
respect to the selected motion vector is discrete cosine 
transformed in the DCT core 113, quantized in the Q core 

35 114, variable length coded in the VLC core 115 together 
with side information such as the motion vectors found, 
and finally provided as the encoded data 122. 
[001 8] The above is discussed in detail with reference 
to FIGURE 2. The task controller 201 first sets an oper- 

40 ating parameter to the MD core register file 21 1 through 
the signal line 231 , the ALU 223, and the C bus 243 and 
provides the activation signal 123 to make the MD core 

111 active. The MD core 111 reads in the operating pa- 
rameter from the MD core register file 211 through the 

45 signal line 131 and inputs the image data 121 . Upon ter- 
mination of the execution of the MD core 111, candidate 
motion vectors found in the MD core 111 are written into 
the MD core register file 21 1 through the signal line 131 , 
and the MD core 111 provides the termination signal 124. 

50 in response to the termination signal 124, the task con- 
troller 201 reads out the candidate motion vectors from 
the MD core register file 211. Based on the candidate 
motion vectors, the task controller 201 computes an op- 
erating parameter for the MC core 1 12 by the use of the 

55 multiplier 221 , the shifter 222, the ALU 223, and the gen- 
eral-purpose register file 217. The operating parameter 
is set to the MC core register file 212 and the MC core 

1 1 2 is made active by the activation signal 1 23. The MC 
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core 112 reads in the operating parameter from the MC 
core register file 212 through the signal line 132. There- 
after, the MC core 112 finds image differential data. Upon 
termination of the execution of the MC core 1 12, a sum 
of the image differential data is written into the MC core 
register file 212 byway of the signal line 132, the image 
differential data are written into the buffer memory 116, 
and the MC core 112 provides the termination signal 1 24. 
In response to the termination signal 124, the task con- 
troller 201 reads out the image differential data sum from 
the MC core register file 212. Based on the image differ- 
ential data sum, the task controller 201 selects an opti- 
mum motion vector from among the aforesaid candidate 
motion vectors through the use of the multiplier 221 , the 
shifter 222, the ALU 223, and the general-purpose reg- 
ister file 217. An address indicative of the location of dif- 
ferential data corresponding to the optimum motion vec- 
tor is set in the DCT core register file 213 and the DCT 
core 113 is made active by the activation signal 123. 
Based on the address set in the DCT core register file 
213, the DCT core 113 reads out the differential data 
from the buffer memory 116 for DCT. Upon termination 
of the execution of the DCT core 1 1 3, a result of the DCT 
operation is written into the buffer memory 1 17 and the 
DCT core 113 provides the termination signal 124. The 
Q core 114 performs quantization and a result of the 
quantization operation is written into the buffer memory 
118. The VLC core 1 1 5 performs VLC and a result of the 
VLC operation is provided as the encoded data 122. 
Some of the five cores 111-115 exchange the signals 
123 and 124 with the microcontroller 101 a plurality of 
times per macroblock processing. The common register 
file 216 is used in cases such as when a common pa- 
rameter for switching between MPEG1 and MPEG2 is 
pre-supplied to the five cores 111 and when a common 
parameter for designating a motion estimation mode is 
pre-supplied to the cores 111 and 112. 
[001 9] Referring to FIGURE 3, the structure of the task 
controller 201 is now described in detail. The task con- 
troller201 has a processor 300, ataskmanagementtable 
310, and a scheduler 330. The processor 300 is a RISC 
(reduced instruction set computer) processor capable of 
sequential execution of eight tasks at most. The proces- 
sor 300 has a program counter (PC) 301 for generating 
instruction addresses, an instruction memory 302 for 
storing a program of a series of instructions, and an in- 
struction decoder 303 for decoding instructions. The in- 
struction decoder 303 sends the activation signal 123 to 
each core. The instruction decoder 303 is connected to 
resources for the execution of instructions, such as the 
multiplier 221 , the shifter 222 and the ALU 223, through 
the signal line 231 . The task management table 31 0 is a 
circuit block for storing task management information. 
The task management table 31 0 has eight task manage- 
ment register files 320-327 that are associated with eight 
tasks from TASK0 to TASK7, respectively. The task man- 
agement information includes state information (ST IN- 
FO) representative of the execution status of each task, 



priority information (PRI INFO) representative of the ex- 
ecution priority of each task, and core identification infor- 
mation (CID INFO) representative of the allocation of the 
tasks to the five cores 111-115. Additionally, the task 

5 management table 310 has PC regions for the tasks for 
saving the processor's 300 resources (i.e., the contents 
of the PC 301 ). Such a region is also used to save a flag 
concerning a result of the arithmetic operation of the ALU 
223 (see FIGURE 2). The scheduler 330 is a circuit block 

10 operable to allows the processor 300 to switch between 
tasks on the basis of the task management information 
stored in the task management table 31 0. The scheduler 
330 has a state controller 331 , a terminated core deter- 
mination unit (TCDU) 332, a priority encoder 333, and a 

15 selector 334. In response to the termination signal 124 
sent from any one of the five cores 111-115 (i.e., a core 
the execution of which isterminated),theTCDU322 iden- 
tifies a task allocated to that execution-terminated core. 
Such identification is carried out with reference to the 

20 task management table 31 0 and a task number 362 rep- 
resentative of a result of the identification operation is 
communicated to the state controller 331. The priority 
encoder 333 is a circuit block for selecting a task to be 
run next. Referring to the task management table 310, 

25 the priority encoder 333 performs such a selection oper- 
ation and a task number 361 representative of a result 
of the selection operation is communicated to the state 
controller 331 as well as to the selector 334. The state 
controller 331 is a circuit block for updating the ST INFO 

30 stored in the task management table 310. The selector 
334 controls the restoration of resources to the processor 
300. 

[0020] FIGURE 4 illustrates an association between 
the cores and the tasks in the MPEG image encoder of 

35 FIGURE 1. Here, the microcontroller 101 executes six 
tasks 400-405. The task 400 controls the five tasks 
401-405 lower in hierarchy than the task 400 and is a 
main task (TASK0) for managing the entire encoding 
processing. The main task 400 is assigned no core. The 

40 task 401 is a motion detection task (TASK1 ) for control- 
ling the allocated MD core 111. The task 402 is a motion 
compensation task (TASK2) for controlling the allocated 
MC core 112. The task 403 is a DCT task (TASK3) for 
controlling the allocated DCT core 113. The task 404 is 

45 a Q task (TASK4) for controlling the allocated Q core 
1 1 4. Finally, the task 405 is a VLC task (TASKS) for con- 
trolling the allocated VLC core 115. 
[0021] Suppose here that the task management table 
310 of FIGURE 3 stores task management information 

50 concerning at least six tasks (the six tasks 400-405). Re- 
ferring to FIGURE 3, the PRI INFO is set according to a 
priority setting signal 342. The CID INFO is set according 
to a core setting signal 343. The priority setting signal 
342 is sent to the task management table 310 from the 

55 instruction decoder 303 if the instruction decoder 303 
decodes a priority setting instruction. On the other hand, 
the core setting signal 343 is sent to the task manage- 
ment table 310 from the instruction decoder 303 if the 
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instruction decoder 303 decodes a core setting instruc- 
tion. 

[0022] FIGURE 5 is a conceptual diagram showing the 
state transition of each task. Each task can be in one of 
four states, namely, the state of STOP representative of 
a suspended status, the state of READY representative 
of an execution wait status, the state of ACTIVE repre- 
sentative of a running status, and the state of SLEEP 
representative of an allocated hardware engine execu- 
tion termination wait status. SLEEP cannot exist for 
TASKO. If the task controller 201 is reset, it will assume 
the state of STOP for all tasks. A task in the state of STOP 
is changed to READY by a task_ready instruction (in oth- 
er words, a transition 501 is made). If a task in the state 
of READY is selected by the scheduler 330 when an 
event requesting for task switching to be made occurs, 
the task is changed to ACTIVE (in other words, a transi- 
tion 51 1 is made), at which time a task which has been 
placed in the state of ACTIVE up to the moment is 
changed to READY by the scheduler 330 (in other words, 
a transition 522 is made). A task in the state of ACTIVE 
is executed by the processor 300. A task in the state of 
ACTIVE can be changed to SLEEP by a task_sleep in- 
struction (in other words, a transition 521 is made), alter- 
natively it can be changed to STOP by a task_stop in- 
struction (in other words, a transition 523 is made). A 
task in the state of SLEEP is changed to READY (in other 
words, a transition 531 is made) if the execution of a core 
allocated to that task is terminated. 
[0023] Details of the operation of the task controller 
201 of FIGURE 3 are described here. Task switching 
occurs if the instruction decoder 303 decodes the task_ 
ready instruction, the task_sleep instruction, or the task_ 
stop instruction. For example, when a certain task is run 
to finish setting an operating parameter for a core allo- 
cated to the task and activating the core, the state of the 
task is changed from ACTIVE to SLEEP by the task_ 
sleep instruction. Additionally, task switching occurs up- 
on termination of the execution of any one of the five 
cores 111-115. The operating sequence of the task con- 
troller 201 at task switching time includes (1) activating 
the scheduler (SCHEDULER ACTIVATION), (2) saving 
the resources of a task under execution (RESOURCE 
SAVING), (3) selecting a task to be run next (TASK SE- 
LECTION), and (4) restoring the saved resources (RE- 
SOURCE RESTORATION). 

[0024] Firstly, a task switching sequence on the basis 
of instructions is explained. 

(A-1) SCHEDULER ACTIVATION 

[0025] If the task_ready instruction, the task_sleep in- 
struction, or the task_stop instruction is decoded, the in- 
struction decoder 303 provides a state change signal 
341. The state change signal 341 is sent to the state 
controller 331. As a result, the scheduler 330 is made 
active. 



(A-2) RESOURCE SAVING 

[0026] The state change signal 341 is also sent to the 
task management table 310 and the ST INFO is updated. 
5 At the same time, the value of the PC 301 of a task which 
has been executed up to the moment is saved in the task 
management table 310 through a signal line 344. 

(A-3) TASK SELECTION 

10 

[0027] The priority encoder 333 receives from the task 
management table 310 the ST INFO and the PRI INFO 
through a signal line 351 and through a signal line 352 
respectively, to select a task having the highest priority 
15 of execution in all tasks that are in the state of READY 
as a task to be run next. The task number 361 indicative 
of a result of the task selection operation is communicat- 
ed to the state controller 331 and to the selector 334. 



[0028] The state controller 331 sends to the task man- 
agement table 310 a state change signal 364 according 
to the task number 361 . As a result, the ST INFO of the 
task selected by the priority encoder 333 is updated from 
READY to ACTIVE. The selector 334 reads out the PC 
of the task designated by the task number 361 from the 
task management table 310 through a signal line 353, 
for forwarding onto a signal line 363. As a result, the value 
of the PC of the task to be run next is set in the processor 
300 and the execution of the task starts. 
[0029] Next, a task switching sequence on the basis 
of core execution termination is now described. 



[0030] If the execution of any one of the cores is ter- 
minated, the termination signal 124 is sent to the TCDU 
332. The TCDU 332 determines which of the cores is 
execution-terminated on the basis of the termination sig- 
nal 124. Further, the TCDU 332 reads out the CID INFO 
stored inthetaskmanagementtable310through asignal 
line 354 and determines which of the tasks is allocated 
to the execution-terminated core. The task number 362 
indicative of a result of the determination operation by 
the TCDU 332 is communicated to the state controller 
331 if the task in question is confirmed to be in the state 
of SLEEP from the ST INFO, in consequence of which 
the scheduler 330 is activated. The state controller 331 
sends to the task management table 310 the state 
change signal 364 according to the task number 362, as 
a result of which the ST INFO of the execution-terminated 
task is updated from SLEEP to READY. The scheduler 
330 will not be activated if there exists no task allocated 
to the execution-terminated core. 



20 (A-4) RESOURCE RESTORATION 
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(B-2) RESOURCE SAVING 

[0031] The state controller 331 sends the state change 
signal 364 to the task management table 310 so that the 
ST INFO of a task that has been under execution up to 
the moment is updated from ACTIVE to READY. At the 
same time, the value of the PC 301 of the task is saved 
in the task management table 310. 

(B-3) TASK SELECTION 

[0032] The priority encoder 333 receives the ST INFO 
and the PRI INFO from the task management table 310 
thereby selecting a task having the highest priority of ex- 
ecution in all tasks in the state of READY as a task to be 
run next. The task number 361 indicative of a result of 
the task selection operation is communicated to the state 
controller 331 as well as to the selector 334. 

(B-4) RESOURCE RESTORATION 

[0033] The state controller 331 sends to the task man- 
agement table 31 0 the state change signal 364 according 
to the task number 361 . The ST INFO of the task selected 
by the priority encoder 333 is updated from READY to 
ACTIVE. The selector 334 reads out the PC of the task 
designated by the task number 361 from the task man- 
agement table 310, for forwarding to the processor 300. 
As a result, the value of the PC of the task to be run next 
is set in the processor 300 and the execution of the task 
in question starts. 

[0034] Referring now to FIGURE 6, therein shown is 
macroblock pipeline processing by the five cores 
11 1-1 15 of FIGURE 1. The pipeline pitch is set at a max- 
imum value of the time taken to process one macro block 
in each core, which means that there is a characteristic 
that in the individual pipeline pitches, there exists a core 
the execution of which is terminated earlier than the other 
cores. This therefore produces idle time and there is a 
characteristic that the length of such idle time varies de- 
pending on the image data. In the example of FIGURE 
1, an MPEG image encoder adaptive to the foregoing 
characteristics is implemented by means of task switch- 
ing adopting an event driven method. The number of 
times a core is activated in an individual pipeline pitch 
period varies depending on the contents and data of 
processing carried out in the core. For instance, the DCT 
core 113 is activated once per pipeline pitch period. On 
the other hand, the MC core 112 is activated a plurality 
of times per pipeline pitch period depending on the data, 
since in the MC core 112 data of one macroblock is di- 
vided into luminance and chrominance components and 
processing is subdivided for the components and carried 
out. 

[0035] FIGURE 7 shows the state transition of each of 
three tasks in a part period specified by broken line of 
FIGURE 6. TASK0 is a main task for managing an entire 
encoding process, TASK1 is a task allocated to the MD 



core 111, and TASK2 is a task allocated to the MC core 
112 (see FIGURE 4). In these three tasks, TASK1 has 
the highest execution priority. TASK2 has the second 
highest execution priority. TASK0 has the lowest execu- 
5 tion priority. Suppose that at time to, TASK1 is in the state 
of ACTIVE and TASK0 and TASK2 are in the state of 
READY. 

[0036] FIGURE 7 shows that task switching occurs at 
each timet1-t7. In FIGURE 7, At representsthe overhead 

10 of one task switching operation. The description will be 
made in order. TASK1 makes the MD core 111 active 
prior to time t1 . At time t1 , the state of TASK1 is changed 
from ACTIVE to SLEEP by the task_sleep instruction. At 
this point in time, although TASK0 and TASK2 are in the 

15 state of READY, it is TASK2 that is allowed to make a 
transition from READY to ACTIVE, since TASK2 has pri- 
ority of execution over that of TASK0. TASK2 makes the 
MCcore 112 active. Then, at time t2, the state of TASK2 
is changed from ACTIVE to SLEEP by the task_sleep 

20 instruction. At this point in time, only TASK0 assumes 
the state of READY. TASK0 therefore makes a state tran- 
sition from READY to ACTIVE. At time t3, the state of 
TASK2 is changed from SLEEP to READY by the exe- 
cution termination of the MC core 112 and the state of 

25 TASK0 (which has been in the state of ACTIVE up to the 
moment) moves to READY. At this point in time, although 
TASK0 and TASK2 are in the state of R EADY, it is TASK2 
that is allowed to make a state transition from READY to 
ACTIVE, since TASK2 has priority of execution over that 

30 of TASK0. TASK2 again activates the MC core 112. At 
time t4, the state of TASK2 is changed from ACTIVE to 
SLEEP by the task_sleep instruction, at which point in 
time only TASK0 is in the state of READY. TASK0 there- 
fore makes a state transition from READY to ACTIVE. 

35 At time t5, the state of TASK1 is changed from SLEEP 
to READY by the execution termination of the MD core 
111 and the state of TASK0 (which has been in the state 
of ACTIVE up to the moment) moves to READY. At this 
point in time, although TASK0 and TASK1 are in the state 

^o of READY, it is TASK1 that is allowed to make a state 
transition from READY to ACTIVE, since TASK1 has pri- 
ority of execution over that of TASK0. At time t6, the state 
of TASK2 is changed from SLEEP to READY by the ex- 
ecution termination of the MC core 112 and the state of 

45 TASK1 (which has been in the state of ACTIVE up to the 
moment) moves to READY. At this point in time, although 
TASK0, TASK1, and TASK2 are all in the state of 
READY, it is TASK1 that is allowed to return to ACTIVE 
from READY, since TASK1 has the highest execution 

50 priority in all the tasks. TASK1 again makes the MD core 
111 active. At time t7, the state of TASK1 is changed 
from ACTIVE to SLEEP by the task_sleep instruction. At 
this point in time, although TASK0 and TASK2 are in the 
state of READY, it is TASK2 that is allowed to make a 

55 state transition from READY to ACTIVE, since TASK2 
has priority of execution over that of TASK0. 
[0037] In cases where task switching, based on a time 
sharing method utilizing a conventional interruption han- 
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dling routine, is adopted, the overhead of one task switch- 
ing operation amounts to ten-odd machine cycles. On 
the other hand, for the case of task switching based on 
an event driven method according to the present inven- 
tion, the overhead, At, of FIGURE 7 is only several ma- 
chine cycles. Taking into accountthefactthattaskswitch- 
ing occurs twenty-odd times at most in an individual mac- 
ropipeline pitch period, the difference in overhead be- 
tween the foregoing methods further increases. Reduc- 
tion in the overhead achieved by the present invention 
makes it possible to achieve also a reduction in the pipe- 
line pitch. In other words, it is possible to achieve high- 
speed encoding of image data. 

[0038] As described above, high-speed task switching 
can be realized in the MPEG image encoder of FIGURE 
1. If a task that executes a time critical process is as- 
signed higher priority of execution, this guarantees nor- 
mal image encoding processing. When the execution of 
a core is terminated, both the state of a task allocated to 
the execution-terminated core and the state of a task 
which has been under execution up to the moment are 
first changed to READY, and a task having the highest 
priority of execution in all tasks in the state of READY is 
selected as one to be run next. This can provide a sim- 
plified internal structure to the priority encoder 333. Ad- 
ditionally, it is possible to independently describe pro- 
grams for tasks. This not only improves efficiency in pro- 
gramming but also provides advantages over debugging. 
[0039] The present invention is applicable to other data 
processing systems including an image decoder. In the 
foregoing description, each hardware engine (core) is 
assigned one task. There may be a core that is assigned 
no task. Additionally, there may be a core that is assigned 
a plurality of tasks. The same task is never simultane- 
ously allocated to a plurality of cores. 

Claims 



task management information, including: 

(i) state information representative of 
the execution status of each task, 

5 (ii) priority information representative of 

the execution priority of each task, 
(iii) allocation information representa- 
tive of the allocation of said plurality of 
tasks to said hardware engines, and 

10 (iv) program counter values for each 

task; 

a plurality of register files (211-216) which can 
be used by said hardware engines as mutually 

15 independent working areas, and 

a hardware scheduler (330) for allowing said 
processor to switch between said tasks without 
an interrupt handling routine, on the basis of said 
task management information, 

20 said hardware scheduler (330) including: 

a) a determination unit (332) for identifying 
a task allocated to an execution-terminated 
hardware engine (111-115) on the basis of 

25 said task management information, when 

the execution of any one of said plurality of 
said hardware engines (111-115) is termi- 
nated; 

b) a state controller (331 ) which performs a 
30 function of updating of state information, up- 
on being activated by said determination 
unit (332), and 

c) a selector (334) that reads out a program 
counter value for the task to be run next in 

35 the processor (300) said task being deter- 

mined by said state information and priority 
information and said value being set in the 
processor to start the execution of that task. 



1. A data processing system comprising: 40 

a plurality of hardware engines (111-115) form- 
ing a macro block pipeline, each of the hardware 
engines being assigned one task in a plurality 
of repetitive operations of encoding or decoding 45 
a data stream consisting of consecutive blocks 
of data, and 

a microcontroller (101) for controlling said plu- 
rality of hardware engines, said microcontroller 
adopting an event-driven method capable of 50 
performing task switching in fast response to the 
occurrence of an event, said microcontroller in- 
cluding: 

a processor (300) having a program counter 55 
(301 ) for sequentially executing said plural- 
ity of tasks; 

a task management table (310) for storing 



2. The data processing system according to claim 1 , 
wherein each of said tasks is in one of the following 
states: 

a first state (READY-state) representative of an 
execution wait status, 

a second state (ACTIVE-state) representative 
of a running status, and 

a third state (SLEEP-state) representative of a 
wait status awaiting the termination of execution 
of a hardware engine (111-115) allocated there- 
to. 

3. The data processing system according to claim 2, 
wherein when during execution of a task of said plu- 
rality of tasks said microprocessor (101) activates a 
hardware engine (111 - 1 15) allocated to said task 
under execution before decoding a given instruction, 
said microprocessor (1 01) performs a function of up- 
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Vielzahl sich wiederholender Operationen des 
Codierens oder Decodierens eines Daten- 
stroms zugewiesen ist, der aus aufeinanderfol- 
genden Blocken von Daten besteht, und 
5 einen Mikrocontroller (101) zum Steuern der 

Vielzahl von Hardware-Engines, wobei der Mi- 
krocontroller ein ereignisgesteuertes Verfahren 
anwendet, mit dem Aufgabenwechsel in schnel- 
ler Reaktion auf das Auftreten eines Ereignisses 
10 moglich ist, und der Mikrocontroller enthalt: 

einen Prozessor (300) mit einem Pro- 
grammzahler (301) zum sequenziellen 
Ausfuhren der Vielzahl von Aufgaben; 
15 eine Aufgabenverwaltungstabelle (310) 

zum Speichern von Aufgaben verwaltungs- 
informationen, die einschlieGen: 

I) Zustandsinformationen, die repra- 
20 sentativ fur den Ausfuhrungszustand 

jeder Aufgabe sind, 

II) Prioritatsinformationen, die repra- 
sentativ fur die Ausfuhrungsprioritat je- 
der Aufgabe sind, 

25 ill) Zuordnungsinformationen, die re- 



dating said state information so that said task makes 
a state transition from said second state (ACTIVE- 
state) to said third state (SLEEP-state). 

4. The data processing system according to claim 2, 
wherein: 

the state controller (331) performs the function 
of updating said state information when a task 
makes a state transition from said third state 
(SLEEP-state) to said first state (READY-state). 

5. The data processing system according to claim 4, 
wherein said state controller (331) performs, upon 
being activated by said determination unit (332), a 
function of updating said state information so that a 
task under execution makes a state transition from 
said second state (ACTIVE-state) to said first state 
(READY-state). 

6. The data processing system according to claim 2, 
wherein said scheduler (330) further includes a pri- 
ority encoder (333) for selecting, on the basis of said 
task management information, a task having the 
highest execution priority in all tasks that are in said 
first state (READY-state) as a task to be run next. 

7. The data processing system according to claim 6, 
wherein said state controller (331) further performs 
a function of updating said state information so that 30 
said task selected by said priority encoder (333) 
makes a state transition from said first state 
(READY-state) to said second state (ACTIVE-state). 

8. The data processing system according to any of 35 
claims 1 - 7, wherein said task management table 
(310) has a region in which to save resources of said 
processor (300) concerning a task that was run prior 

to the occurrence of a task switching. 

40 

9. The data processing system according to any of 
claims 1 - 8, further comprising a register file (216) 
used to store a setting parameter common to at least 
two of said plurality of hardware engines. 

45 

10. The data processing system according to any of 
claims 1 - 9, wherein each of said plurality of hard- 
ware engines (111 - 115) is a subprocessing core 
for MPEG image data encoding. 



Patentanspruche 

1. Datenverarbeitungssystem, das umfasst: 

eine Vielzahl von Hardware-Engines (111-115), 
die eine Makroblock-Pipeline bilden, wobei je- 
der der Hardware-Engines eine Aufgabe einer 



prasentativ fur die Zuordnung der Viel- 
zahl von Aufgaben zu den Hardware- 
Engines sind, und 

IV) Programmzahlerwerte fur jede Auf- 
gabe; 

eine Vielzahl von Registerdateien (21 1 -21 6), die 
von den Hardware-Engines als voneinander un- 
abhangige Arbeitsbereiche verwendet werden 
konnen, und 

einen Hardware-Scheduler (330), der es dem 
Prozessor ermoglicht, auf Basis der Aufgaben- 
verwaltungsinformationen ohne eine Interrupt- 
Abwicklungsroutine zwischen den Aufgaben zu 
wechseln, 

wobei der Hardware-Scheduler (330) enthalt: 

a) eine Feststelleinheit (332) zum Identifizieren 
einer Aufgabe, die einer Hardware-Engine 
(111-115), deren Ausfuhrung beendet ist, auf 
Basis der Aufgabenverwaltungsinformationen 
zugewiesen wird, wenn die Ausfuhrung einer 
der Vielzahl der Hardware-Engines (111-115) 
beendet ist; 

b) eine Zustands-Steuereinheit (331), die eine 
Funktion des Aktualisierens von Zustandsinfor- 
mationen erfullt, wenn sie durch die Feststell- 
einheit (332) aktiviert wird, und 

c) eine Auswahleinrichtung (334), die einen Pro- 
grammzahlerwert fur die als nachstes in dem 
Prozessor (300) auszufuhrende Aufgabe aus- 
liest, wobei die Aufgabe durch die Zustandsin- 
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formationen und Prioritatsinformationen be- 
stimmt wird und der Wert in dem Prozessor ein- 
gestellt wird, um mit der Ausfuhrung dieser Auf- 
gabe zu beginnen. 

2. Datenverarbeitungssystem nach Anspruch 1 , wobei 
sich jede der Aufgaben in einem der folgenden Zu- 
stande befindet: 

einem ersten Zustand (READY-Zustand), der 
reprasentativ fur einen Ausfuhrungs-Wartezu- 
stand ist, 

einem zweiten Zustand (ACTIVE-Zustand), der 
reprasentativ fur einen Ausfuhrungszustand ist, 
und 

einem dritten Zustand (SLEEP-Zustand), der re- 
prasentativ fur einen Wartezustand ist, in dem 
auf die Beendigung von Ausfuhrung einer ihr zu- 
geordneten Hardware-Engine (111-115) gewar- 
tet wird. 

3. Datenverarbeitungssystem nach Anspruch 2, wo- 
bei, wenn wahrend der Ausfuhrung einer Aufgabe 
der Vielzahl von Aufgaben der Mikro prozessor (101) 
eine Hardware-Engine (111-115) aktiviert, die der 
Aufgabe zugeordnet ist, die ausgefuhrt wird, bevor 
ein gegebener Befehl decodiert wird, der Mikropro- 
zessor (1 01 ) eine Funktion des Aktualisieren der Zu- 
standsinformationen erfullt, so dass die Aufgabe ei- 
nen Zustandsubergang von dem zweiten Zustand 
(ACTIVE-Zustand) zu dem dritten Zustand (SLEEP- 
Zustand) vollzieht. 

4. Datenverarbeitungssystem nach Anspruch 2, wo- 
bei: 

die Zustands-Steuereinheit (331) die Funktion 
des Aktualisierens der Zustandsinformationen 
erfullt, wenn eine Aufgabe einen Zustandsuber- 
gang von dem dritten Zustand (SLEEP-Zu- 
stand) zu dem ersten Zustand (READY-Zu- 
stand) vollzieht. 

5. Datenverarbeitungssystem nach Anspruch 4, wobei 
die Zustands-Steuereinheit (331), wenn sie durch 
die Feststelleinheit (332) aktiviert wird, eine Funktion 
des Aktualisierens der Zustandsinformation so er- 
fullt, dass eine Aufgabe, die ausgefuhrt wird, einen 
Zustandsubergang von dem zweiten Zustand (AC- 
TIVE-Zustand) zu dem ersten Zustand (READY-Zu- 
stand) vollzieht. 

6. Datenverarbeitungssystem nach Anspruch 2, wobei 
der Scheduler (330) des Weiteren eine Prioritats- 
Codiereinrichtung (333) enthalt, mit der auf Basis 
der Aufgabenverwaltungsinformationen eine Aufga- 
be mit der hochsten Ausfuhrungsprioritat von alien 
Aufgaben, die sich in dem ersten Zustand (READY- 



Zustand) befinden, als eine als nachste auszufuh- 
rende Aufgabe ausgewahlt wird. 

7. Datenverarbeitungssystem nach Anspruch 6, wobei 
5 die Zustands-Steuereinheit (331 ) des Weiteren eine 

Funktion des Aktualisierens der Zustandsinformatio- 
nen so erfullt, dass die durch die Prioritats-Codier- 
einrichtung (333) ausgewahlte Aufgabe einen Zu- 
standsubergang von dem ersten Zustand (READY- 
10 Zustand) zu dem zweiten Zustand (ACTIVE-Zu- 
stand) vollzieht. 

8. Datenverarbeitungssystem nach einem der Anspru- 
che 1 - 7, wobei die Aufgabenverwaltungstabelle 

15 (310) einen Bereich hat, in dem Ressourcen des Pro- 
zessors (300) gespeichert werden, die eine Aufgabe 
betreffen, die vor dem Auftreten eines Aufgaben- 
wechsels ausgefuhrt wurde. 

20 9. Datenverarbeitungssystem nach einem der Anspru- 
che 1 - 8, das des Weiteren eine Registerdatei (21 6) 
umfasst, die verwendet wird, um einen Einstellungs- 
parameter zu speichern, der wenigstens zwei der 
Vielzahl von Hardware-Engines gemeinsam ist. 

25 

1 0. Datenverarbeitungssystem nach einem der Anspru- 
che 1 - 9, wobei jede der Vielzahl von Hardware- 
Engines (111-115) ein Teilverarbeitungs-Kern fur 
MPEG-Bilddaten-Codierung ist. 

30 

Revendications 

1 . Systeme de traitement de donnees comprenant: 

35 

une pluralite de moteurs materiels (111-115) for- 
mant une architecture pipeline au niveau des 
macroblocs, en attribuant une tache a chacun 
des moteurs materiels dans une pluralite d'ope- 
40 rations repetitives consistant a coder ou deco- 

der un flux de donnees de blocs consecutifs de 
donnees, et 

un microcontroleur (1 01 ) destine a commander 
ladite pluralite de moteurs materiels, ledit micro- 
45 controleur adoptant un procede evenementiel 

capable d'executer une commutation de tache 
en reponse rapide a I'occurrence d'un evene- 
ment, ledit microcontroleur incluant: 

50 un processeur (300) ayant un compteur de 

programmes (301) pour executer sequen- 
tiellement ladite pluralite de taches; 
un tableau de gestion de taches (31 0) des- 
tine a stocker des informations concernant 
55 la gestion de taches, incluant: 

(i) des informations d'etat qui represen- 
ted le statut d'execution de chaque ta- 
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che, 

(ii) des informations de priorite qui re- 
presented la priorite d'execution de 
chaque tache, 

(iii) des informations d'attribution qui re- 5 
presentent I'attribution de ladite plura- 
lity de taches auxdits moteurs mate- 
riels, et 

(iv) des valeurs du compteur de pro- 
grammes pour chaque tache; 10 

une pluralite de fichiers de registre (211-216) 
qui peuvent etre utilises par lesdits moteurs ma- 
teriels en tant que zones de travail mutuellement 
independantes, et 15 
un ordonnanceur materiel (330) destine a per- 
mettre audit processeur de basculer entre les- 
dites taches sans un sous-programme de ges- 
tion d'interruption, sur la base desdites informa- 
tions concernant la gestion de taches, 20 
ledit ordonnanceur materiel (330) incluant: 

(a) une unite de determination (332) pour 
identifier une tache attribuee a un moteur 
materiel (1 1 1 -1 1 5) a execution achevee sur 25 
la base desdites informations concernant la 
gestion de taches, lorsque I'execution de 
Tune quelconque de ladite pluralite desdits 
moteurs materiels (111-115) est achevee. 

(b) une unite de commande d'etat (331 ) qui 30 
effectue une fonction de mise a jour des in- 
formations d'etat, a son activation par ladite 
unite de determination (332), et 

c) un selecteur (334) qui lit une valeur du 
compteur de programmes pour la tache a 35 
executer par la suite dans le processeur 
(300), ladite tache etant determinee par les- 
dites informations d'etat et lesdites informa- 
tions de priorite et ladite valeur etant etablie 
dans le processeur pour entamer I'execu- 40 
tion de cette tache. 

2. Systeme de traitement de donnees selon la reven- 
dication 1 , dans lequel chacune desdites taches est 
dans I'un des etats suivants: 45 

un premier etat (etat-PRET) qui represente un 
statut d'attente de I'execution, 
un deuxieme etat (etat-ACTIF) qui represente 
un etat d'execution, et 50 
un troisieme etat (etat-DESACTIVE) qui repre- 
sente un statut d'attente qui attend ('achieve- 
ment de I'execution d'un moteur materiel 
(111-115) qui lui est attribue. 

55 

3. Systeme de traitement de donnees selon la reven- 
dication 2, dans lequel lors de I'execution d'une ta- 
che de ladite pluralite de taches ledit microproces- 



seur (101) active un moteur materiel (111-115) attri- 
bue a ladite tache en cours d'execution avant de 
decoder une instruction donnee, ledit microproces- 
seur (1 01 ) effectue une fonction de mise a jour des- 
dites informations d'etat de sorte que ladite tache 
realise une transition d'etats dudit deuxieme etat 
(etat-ACTIF) audit troisieme etat (etat-DESACTI- 
VE). 

4. Systeme de traitement de donnees selon la reven- 
dication 2, dans lequel: 

I'unite de commande d'etat (331) effectue la 
fonction de mise a jour desdites informations 
d'etat lorsqu'une tache realise une transition 
d'etats dudit troisieme etat (etat-DESACTIVE) 
audit premier etat (etat-PRET). 

5. Systeme de traitement de donnees selon la reven- 
dication 4, dans lequel ladite unite de commande 
d'etat (331 ) effectue, a son-activation par ladite unite 
de determination (332), une fonction de mise a jour 
desdites informations d'etat de sorte qu'une tache 
en cours d'execution realise une transition d'etats 
dudit deuxieme etat (etat-ACTIF) audit premier etat 
(etat-PRET). 

6. Systeme de traitement de donnees selon la reven- 
dication 2, dans lequel ledit ordonnanceur (330) in- 
clut en plus un codeur de priorite (333) pour selec- 
tionner, sur la base desdites informations concer- 
nant la gestion de taches, une tache ayant la priorite 
d'execution la plus elevee parmi toutes les taches 
qui se trouvent dans ledit premier etat (etat-PRET) 
en tant que tache a executer par la suite. 

7. Systeme de traitement de donnees selon la reven- 
dication 6, dans lequel ladite unite de commande 
d'etat (331 ) effectue en plus une fonction de mise a 
jour desdites informations d'etat de sorte que ladite 
tache selectionnee par ledit codeur de priorite (333) 
realise une transition d'etats dudit premier etat (etat- 
PRET) audit deuxieme etat (etat-ACTIF). 

8. Systeme de traitement de donnees selon I'une des 
revendications 1 -7, dans lequel ledit tableau de ges- 
tion de taches (310) a une region dans laquelle Ton 
sauvegarde les ressources dudit processeur (300) 
concernant une tache qui a ete executee avant I'oc- 
currence d'une commutation de taches. 

9. Systeme de traitement de donnees selon I'une des 
revendications 1 -8, comprenant en plus un fichier de 
registre (216) utilise pour stocker un parametre de 
reglage commun a au moins deux moteurs parmi 
ladite pluralite de moteurs materiels. 

10. Systeme de traitement de donnees selon I'une des 
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revendications 1 -9, dans lequel chacun de ladite plu- 
rality de moteurs materiels (111-115) est un noyau 
de sous-traitement pour un codage de donnees 
d'images MPEG. 
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